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Abstract 

We consider the problem of an auctioneer who faces the task of selling a good (drawn from 
a known distribution) to a set of buyers, when the seller does not have the capacity to describe 
to the buyers the exact identity of the good that he is selling. Instead, he must come up 
with a constrained signalling scheme: a (non injective) mapping from goods to signals, that 
satisfies the constraints of his setting. For example, the auctioneer may be able to communicate 
only a bounded length message for each good (equivalently, he may be constrained to using 
only a fixed number of signals in total). The auctioneer may also face additional exogenously 
imposed constrains on the signaling scheme - for example, he might be legally constrained to 
truthfully advertise the item being sold. Each candidate signaling scheme induces an incomplete- 
ly^ . information game among the buyers, and the goal of the mechanism designer is to choose the 
signaling scheme that optimizes either welfare or revenue. In this paper, we give algorithms for 
computing constrained signaling schemes, as well as hardness results, for both of these objectives 
for a variety of constrained signaling problems. 



1 Introduction 



At a cafe in Portlandia ABKllI ]. customers about to order the chicken ask the waitress for more 
details regarding its source. She informs them that the chicken is a heritage breed, woodland raised, 
■ and has been fed a diet of sheep's milk, soy, and hazelnuts, and she assures them that the chicken 

is indeed local, free range, and so on. Ah but, the customers ask, is that USDA Organic, or Oregon 
Organic, or Portland Organic? 

Organic certifications are a means by which a seller can communicate parameters of a product 
to potential buyers. The certification system creates a simplified and practical, yet sufficiently 



expressive, set of signals as the basis for this communication Signaling is common throughout 
complex markets. The USDA classifies meat into a small number of discrete grades. Graduating 
high-school students signal their potential to employers and colleges through SAT scores and tran- 
scripts. Targeted advertising sales in both online and offline media describe viewers to ad buyers 
through a fixed and (comparatively) small set of demographic information!! 
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1 Unfortunately for the waitress in Portlandia, the language was not sufficiently expressive for her customers. They 
decided to drive to the farm to visit the chicken 's hom e. 

bee Milgrom [Milld ] and Levin and Milgrom [LMld ] for further discussion of signaling in various markets including 
online advertising, wheat sales, diamond sales, and spectrum auctions. 
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A signaling scheme for a market maps each potential item to a signal. Buyers, upon viewing 
the signal, use their knowledge of the signaling scheme to refine their beliefs about the identity 
of the item for sale and update their value accordingly For example, a seller of skinny jeans 
participating in an online advertising auction might have a high value for viewers that are hipsters 
and no value for retirees or rappers. Thus a signaling scheme that indicates age and geographical 
location will enable the advertiser to distinguish 20-somethings in Brooklyn from 70-somethings 
in Fort Lauderdale and thus separate retirees from hipsters, but conflate hipsters and rappers. If 
viewers are equally likely to be hipsters, retirees, or rappers, and the advertiser learns the viewer 
is a 20-something from Brooklyn, then he updates his expected value for the viewer to be half that 
of his value for a hipster. The choice of signaling scheme induces a game amongst buyers: the 
buyers find themselves competing in an auction without knowing what the good for sale is, but 
rather only knowing that it is some good that induced a signal s from a known signaling scheme. 
Thus, the choice of signaling scheme by the auctioneer corresponds to a particular refinement of 
the information-set presented to the buyers, and different choices can result in auctions that result 
in different degrees of welfare or revenue. 

Practical settings impose a variety of objectives and constraints on this signaling game. First 
and foremost, for a signaling scheme to be useful as a means of communication, it must satisfy 
certain informational constraints. In particular, in many markets, the amount of information that 
can be conveyed is highly constrained. In online advertising auctions, the sheer volume of sales and 
diversity of viewers make it impractical to communicate precise details of every viewer. In addition, 
various reputational and legal constraints may restrict a seller from announcing certain signals for 
certain items: e.g., organic products must pass a certification process from the corresponding agency 
to be sold under that label. The choice of sale mechanism is also up for debate. Sellers typically 
wish to maximizes particular objectives, like welfare or revenue, and so would like to choose a 
signaling scheme and corresponding mechanism that achieves that goal. If this were the extent of 
the problem, a seller could choose a revenue or welfare optimal mechanism, subject to the constraints 
of the setting. However, in multi-item settings with complex valuations, these mechanisms are often 
complicated. Furthermore, due to historical reasons, legal reasons, or buyer anonymity, sellers often 
face additional constraints on feasible mechanisms. In online advertising auctions, for example, the 
industry standard sells a single ad slot with a second price auction. Alternate mechanisms may 
enjoy better theoretical properties, but would receive significant backlash from the buyer base. 

In this paper, we study welfare and revenue optimal signaling schemes in which the seller 
is constrained in both the feasible schemes and the sale mechanism. We consider the natural 
constraint of requiring our signaling schemes to have bounded cardinality. This is equivalent to 
having a bound on the communication that is allowed when transmitting a signal (it takes at most 
log k bits to transmit a signal that is one among a set of k possible signals) . We sometimes also 
consider other, exogenously imposed constrains. In bipartite signaling, we are given a subset of 
feasible signals, and each item is allowed to be mapped to any one of a subset of these signals. For 
example, a signaling scheme for online advertising auctions may consist of all potential tuples of 
attributes: age, location, ethnicity, gender, and income, say. A viewer can be matched to any tuple 
that matches his true characteristics. So a hipster who is a white 20-something Brooklyn boy with 
no income can be mapped to the "20-somethings in Brooklyn" signal, in which case he might be 
conflated with a rapper, or the "person with no income" signal, in which case he might be conflated 
with a retiree. Cardinality-constrained signaling is a special-case of bipartite signaling in which 
any item can be mapped to any signal, but the number of signals is constrained. This special case 
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makes sense in settings where items can be grouped arbitrarily. We prove positive and negative 
results for bipartite and cardinality constrained signaling, in a setting with a discrete set of items 
and signals. 

Finally, consider communication-bounded signaling, in which the constraint is the amount of 
communication which can be used to send the signaO. Our hipster may visit a bar and be faced 
with the decision of whether or not to order an "Old Chub" Ale. This micro-brew is a complex 
chemical mixture, with a consistency and taste that is impossible to fully describe in a reasonable 
amount of time. Instead, the brewery chooses a one sentence description^ which fails to capture 
every detail, but is the best description of the item given the space constraints. We give general 
signaling schemes for items which are described as vectors in d dimensional real valued space, for 
bidders who have geometric valuation functions for the goods, which can be communicated using 
<C d bits. In this setting, we are able to give strong results in the unknown valuation setting, 
in which valuations can be drawn from an arbitrarily correlated prior, sometimes even when it is 
unknown to the mechanism choosing the signalling scheme. 

We impose several additional assumptions on our setting. First, as mentioned above, we assume 
the seller is constrained to use a second-price auctionjf] Second, the choice of signaling scheme is 
clearly influenced by what the seller knows about buyers' values. If all buyers that value hipsters 
also value rappers, then there is no loss in mapping these two viewer types to the same signal. 
As is standard, we model values as being drawn from a common prior and allow the seller to 
choose a signaling scheme based on this prior. We call this the unknown valuation setting, and 
study the properties of the resulting second-price auction in the induced incomplete information 
game. We are able to give strong results in this setting for geometric valuation functions, in 
the bounded communication regime - sometimes even when the prior itself is unknown to the 
mechanism designer. Unfortunately, some of our problems prove fairly difficult in this setting, and 
thus we also study the somewhat less natural known valuation setting in which the seller knows the 
set of values of the buyers precisely. This induces a complete information game. Our motivation for 
studying this setting is two-fold: for one, we hope that it will lead to mechanisms for the unknown 
valuations case, and indeed some of our results carry through when the amount of uncertainty in 
the unknown valuations case is bounded in some sense. 

We also note that our mechanisms for known valuations treat buyers anonymously. Thus these 
mechanisms might be applicable to large markets in which the seller can be fairly certain of the set 
of values but not of the identity of the different buyers. Specifically, consider settings where a seller 
expects customers to belong to one of a number of demographics, or types, with one customer from 
each type arriving with high probability. Then with high probability, several customers of each type 
arrive. In this case, it is easy to see that the revenue and welfare of a signaling scheme are equal, 
with high probability, to the welfare of the signaling scheme for customers with known valuations 
equal to the types. Therefore, if an approximately welfare-maximizing scheme can be computed in 
polynomial time in the known-valuations variant of the problem, a revenue and welfare maximizing 
signaling scheme can be computed in the unknown valuation setting as well. 

3 This is of course the same as cardinality-constrained signaling, but the change in perspective of viewing the 
constraint as being the description length of each signal can be useful. 

4 "This jaw-dropping Scottish strong ale (8% ABV) is brewed with bodacious amounts of malted barley and 
specialty grains, and a dash of beechwood-smoked malt." 

5 Alternatively, we could state our results in terms of posted-price mechanisms; this does not significantly alter the 
underlying optimization problem and so most of our results apply to this alternate assumption as well. 
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Our Contributions We first observe that welfare maximization in constrained signaling with 
unknown valuations is a convex function maximization problem. Thus there is always a determinis- 
tic signaling scheme which maximizes expected welfare. This significantly simplifies our analysis, as 
we only have to search over deterministic signaling schemes. Furthermore, we observe that revenue 
and welfare are intimately related: the revenue is at most the welfare after excluding an arbitrary 
player. This allows us to extend some of our welfare results to the revenue setting. 

We next study the bipartite signaling setting. In the known valuations case, we are able to 
reduce the welfare problem to submodular function maximization subject to a matroid constraint, 
thus implying a (1 — l/e)-approximation for welfare maximization. Starting from our approximately 
welfare-maximizing signaling scheme, and using the connection between revenue and welfare de- 
scribed above as well as careful "mixing" of different signals, we devise a constant approximation 
for revenue maximization in the cardinality-constrained signaling setting. We further show how to 
extend some of our results to the unknown valuation case when the prior has constant-size sup- 
port. We couple our results with a hardness result: even in the cardinality-constrained signaling 
setting with known valuations, it is NP-hard to approximate either objective to a factor better than 
(1 — 1/e) via a reduction from max-cover. 

Finally, we study communication-constrained signaling. We consider settings in which goods 
are points in a very high dimensional space f2 = M. d , where d is much too large to communicate the 
entire vectors. In these settings, we consider agents who have geometric utility functions, defined 
in terms of either the distance or the angle from the realized good to some target good or set of 
goods. We use techniques from no regret learning and metric embeddings to give highly space 
efficient signaling schemes that achieve nearly the optimal welfare (compared even to the optimal 
unconstrained signaling scheme), for the unknown valuation case, and in one instance, even against 
adversarially chosen goods, and without knowledge of the prior distribution over valuations. 



Related Work The study of markets with information asymmetries between sellers and buyers 
was first introduced by Akerlof [Ake70l | . Since then, a rich literature has examined the effects 
of information revelation, i.e. sign aling, in markets and auctions. Most notably, the "Linkage 
principle" of Milgrom and Weber [MW82l | shows that, under some conditions, a seller always 
increases his revenue by signalling more information about the good for sale. However the linkage 
principle requires fairly strong assumptions regarding the joint distribution of player valuations for 
the good. In particular, it rarely holds in settings where players come from different demographics 
with negatively correlated values for the go od. A rev iew of the literature studying the limits of the 
linkage principle can be found in Emek et al EFG + 12l | . The non-applicability of the linkage principle 
to the settings we consider goes even beyond these limitations — even when full transparency is 
optimal for an auctioneer, the presence of constraints on the amount and nature of information 
revealed by our signalling schemes introduces intricate tradeoffs in choosing which information 
to reveal. Quantifying those tradeoffs inevitably requires examination of these settings with an 
optimization lens, as we do here. 

Our work is inspired by, and builds on, recent pa pers that examine optimal signalling s chemes 
in unconstrained settings. Specifically, Emek et al [EFG + 12l ] and Miltersen and Sheffet MS12I ] 



examine signalling for revenue maximization in a second price auction, where no constraints are 
placed on the number or nature of signals. In such settings, full information revelation is optimal 
for an auctioneer interested in maximizing welfare, and both works show that a reven ue-maxim izing 
scheme can be computed efficiently when player valuations are known. Emek et al EFG + 12I ] also 
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obtain partial results for revenue maximization when player valuations are drawn from a Bayesian 
prior. Our results can be thought of as the extension of these works to settings where social, legal, 
or practical constraints are placed on the auctioneer's signaling policy. 

We also mention some results that are related to ours in the techniques used. Fi rst, the problem 
of computing a revenue-maximizing bundling of goods considered in Ghosh et al. GNS07I ] is both 
conceptually and technically similar to the optimization problem we face in our revenue-maximizing 
scheme for cardinality-constrained signaling (Section 14. 2p . The idea of "merging" signals in our 
setting is inspired by their algorithm, though the constraint on the number of signals in our set- 
ting poses additional technical hurdles . The results of Secti on [J] also heavily use techniques from 
the combinatorial auctions litera ture f Feiod . DS06 . DNS05]), as well as the sub modular function 
maximization result of Vondrak Von08l | . 

In the geometric setting considered in Section [5l in which players value goods y £ M. d according 
to inner product valuations, our communicatio n bound ed signaling scheme applies the multiplicative 
weights framework of Arora, Hazan, and Kale [AHKI^ . We use multiplicative weights in an unusual 
way, both as a no-regret learning algorithm and as a compression scheme. That is, we use both the 
fact that multiplicative weights can quickly learn a hypothesis y that closely approximates a vector 
y with respect to a fixed number of inner product valuations, and the fact that the hypothesis y can 
be concisely communicated by transmitting only the update operations of multiplicative weights, 
rather than the vector y itself. We are not aware of multiplicative weights being used explicitly as 
a compression scheme elsewhere, alth ough this is related to the use that no-regret algorithms have 
recently found in differential privacy 



2 Preliminaries 

2.1 Constrained Signalling Problems 

We consider a setting in which there is a set 0, of possible items for sale, and a single item j £ 0, 
is drawn from a distribution p £ A^. There is a set of n players, each of whom is equipped with 
a valuation Vi : O, — >■ M mapping items to the real numbers. The valuation profile (v\,... ,v n ) is 
drawn from a distribution T>. We assume that fi, p, and T> are common knowledge, while each 
player's valuation Vi is private to player i. 

We assume that the realization of item j is ex-ante unknown to the players, but known to the 
auctioneer. We consider an auctioneer who first observes the drawn item j, and then announces a 
string s, known as a signal. The (possibly randomized) policy by which the auctioneer chooses his 
signal, which we refer to as a signaling scheme, is common knowledge. After players observe the 
signal s, which can be thought of as a random variable correlated with the realization of the item 
j, a second price auction for item j is run. 

We adopt the perspective of an auctioneer seeking to optimize his choice of signaling scheme, 
with the goal of maximizing the expected welfare or revenue obtained in the second price auction. 
We focus on settings where, for practical, social, or legal reasons, the auctioneer is constrained in 
their choice of signaling scheme. We therefore define the class of constrained signaling problems, 
as follows. 

Definition 2.1. A constrained signaling problem is a family of instances, each of which is given 
by: 

• A set Q of items, and a distribution p £ Aq over these items. 
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• A set [n] of players, where each player i is equipped by a private valuation v% : SI — > R+. The 
tuple of valuations (v i, . . . , v n ) is drawn from a common prior T>. 

• A set of signals S, and a set T C <S of valid signaling maps. 

When T> is a trivial prior, i.e. {v\ , . . . , v n ) are deterministic, we say our signaling problem 
has known valuations. A solution to a constrained signaling problem is a valid signaling scheme, 
defined as a distribution x E Ajr over valid signaling maps J- . When x is a point distribution, we 
say the signaling scheme is deterministic. Given x and an item j E SI, we use x(j) to denote the 
random variable f(j) for / ~ x. Moreover, given item j E SI and signal s E S, we abuse notation 
and use s) to denote the probability that f(J) = s for / ~ x. Similarly, given a signal s E S 
we use x(s) to denote the probability that f(j) = s for / ~ x and j ~ p; it is easy to see that 

*(«) = ^2jenPj x (j^ s )- 

A signaling scheme x induces, for each signal s, a second-price auction where players have 
independent private values^ Specifically, it is a dominant strategy for each player i to bid his value 
for item j ~ p conditioned on signal s — namely 

The winning player for signal s is the player maximizing Vt\s, x. Parametrized by the valuation 
profile v, the resulting welfare of the auction, in expectation over all draws of the item j, is given 
by 

welfare(x,v):=y x(s) maxims, x = > max> x(j, s)pjVi(j). 
— ' i=i * — ' i=i ^ — ' 

Using Vi{j) := PjV{(J) to denote player i's value for item j weighted by j's probability, gives 

welfare(x,v) = maxV^ x(j, s)vi(j). (1) 
i;: — ' j=i ^ — ' 

ses jen 

And similarly, the revenue in the second price auction is given by 

rev{x,v) := x(s) max2 Vi\s, x = max2 x(j, s)vi(j), (2) 

^ — ' 1=1 — ' i=l * — ' 

ses sg5 jen 

Where max2 denotes selecting the second largest value. In the case of unknown valuations, the 
expected welfare and revenue of the auction over draws of the players' valuations, which we denote 
by welfare(x) and rev(x), are the expectations of welfare(x,v) and rev(x,v), respectively, over 
v ~ D. 



2.2 Example Problems 

Below we define some natural examples of constrained signaling problems. 

6 This crucially relies on the fact that our signaling schemes are "symmetric," in the sense that the auctioneer 
announces the same information — i.e. signal — to all players. An "asymmetric" signaling scheme, which releases 
different information to different players, would induce a second price auction with interdependent values, which we 
avoid in this paper. 
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2.2.1 Bipartite and Cardinality-constrained Signaling 

In a bipartite signaling problem , the set of valid signaling maps is represented explicitly as a 
bipartite graph with f2 on the left hand side, S on the right hand side, and a set of edges £ C fix5, 
as well as an integer k. A signaling map / £ S^ 1 is valid if (j,f(j)) £ E for each j £ Q, and 
moreover < k. We refer to the edge set E as the bipartite graph constraint, which limits 

the compatible signals with each item, and the integer k as the cardinality constraint, which limits 
the total number of signals used. To ensure the existence of at least one feasible signaling map 
and simplify our results, we assume that in instances with k < \S\, there exists a "no information" 
signal so £ S such that (j, sq) £ E for all items j £ Q,. 

We assume the distribution p over items is given explicitly as a vector in [0, l] n . In the known 
valuation variant of the poblem, we also assume the valuation profile is given as a set of vectors 
v\, . . . ,v n £ . For the variant with unknown valuations, we assume for simplicity of presentation 
that the joint distribution V over valuation profiles is given as a set of matrices {v 1 , . . . , v l } where 
v k £ R'"' x1! , and associated probabilities q±, . . . , q t . 

We refer to the special case of this problem where J? = fl x 5, i.e. where the only restriction 
on the signaling scheme is the number of allowed signals, as the cardinality- constrained signaling 
problem. Instances of cardinality-constrained signaling can equivalently be described by a set and 
a number k of allowable signals (S is implicitly assumed to be {1, . . . , k} without loss of generality). 

2.2.2 Communication Bounded Signaling 

In many cases, a product y may be best described as a collection of d features where d is extremely 
large. In other words, goods may be points y £ M. d - natural valuation functions for such points 
take advantage of this Euclidean geometry, and might be represented as the dot product (i.e. the 
angle) between a good and some target point, or the distance between the good and some target 
point or subspace. However, because the dimension of the goods d is so large, it is not possible to 
exactly describe them to buyers, and it is instead necessary to employ a communication bounded 
signaling scheme. Such a scheme places a limit on the amount of communication that can be 
invested in transmitting the signal to the agents. Consider for example the sale of wine. Wine 
is a complicated, high dimensional product, but rather than being described by a full molecular 
description, it is sold with a description that is at most a paragraph in length. Informally, we say 
that a signalling scheme has 6-bounded length of the total set of signals it can generate (over all 
possible products) is of size at most 2 b - note that any signal from such a set can be indexed by 
using at most b bits. 

We say that a bidder i has inner product valuations if bidder i is parameterized by a vector 
V{ £ M. d , and her value for a good y £ M. d is (vi,y). In the known valuation setting, we assume that 
the vectors v\,...,v n are given explicitly. In the unknown valuation setting, we assume that there 
is some prior distribution V from which the vectors Vi are drawn. Our algorithms do not require 
any explicit representation of V , but only the ability to sample from it. 

We say that a bidder has subspace valuations if bidder i is parameterized by k vectors v } , . . . , v \ £ 
IR d , and her value for a good y £ M. d is a function of d{y, S), the Euclidean distance from the good 
y to the subspace spanned by v\, . . . , vf . Our algorithms for signalling with respect to subspace 
valuations work in the unknown valuation setting and yet are independent of the prior distribution 
on values, and so work for arbitrarily complicated priors, even without the ability to sample from 
them. 
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3 Structural Properties 



3.1 Convexity and Determinism 

Given a constrained signaling problem, we observe that welfare is a convex function of the marginal 
probabilities x(j,s), and conclude that the welfare-maximizing constrained signaling scheme is 
deterministic. Formally, for every valid signaling map / G T C S , we associate a vector x* G 
{0, 1}^ X,S where x? (j,s) = 1 if and only if f(j) = s. A signaling scheme is then associated with 
a vector x in the convex hull of {x-^ : / G J-"}, and has welfare and revenue as given in Equations 
CD and respectively. We observe welfare(x) is a convex function of x, and invoke the following 
fact: 

Fact 3.1. Let V be a polytope in Euclidean space, and let g be a convex function. The maximum 
of g over V is attained at a vertex ofV. 

We conclude that there is a welfare-maximizing deterministic signaling scheme. 

Lemma 3.2. For any constrained signaling problem with unknown valuations, there is valid deter- 
ministic signaling scheme which maximizes expected welfare. 

3.2 Relating Revenue and Welfare 

We now mention a useful, though elementary, upper bound on the optimal revenue achievable via a 
signaling scheme. This bound follows immediately from the fact that the revenue of a second price 
auction is at most the welfare of the same auction after excluding an arbitrary player, though we 
present a proof here for completeness. 

Lemma 3.3. Fix an arbitrary constrained signaling problem with unknown valuations. Let i! be 
an arbitrary player. The revenue of the revenue- optimal signaling scheme is at most the welfare of 
the welfare- optimal signaling scheme for all players other than i' . 

Proof. It suffices to show that rev(x,v) (equation ([2])) is at most welfare(x,V-i') (equation (p}). 

rev(x, v) = max2 x(j, s)vi(j) 

— ' i=l — ' 

ses jen 

- ^2 X] (■?) 

= welfare(x,v_i') 

□ 

4 Bipartite Signaling 

In this section we present both positive and negative results for welfare and revenue maximiza- 
tion for bipartite signaling and the special case of cardinality-constrained signaling. In the known 
valuations case, we show the existence of a 1 — 1/e approximation algorithm for welfare maximiza- 
tion in bipartite signaling, and a constant approximation algorithm for revenue maximization in 
cardinality-constrained signaling. Our results extend to the unknown valuations case when the 
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Bayesian prior T> has constant-size support. Finally, we show that even in cardinality constrained 
signaling with known valuations, approximating welfare or revenue to a factor better than 1 — 1/e 
is iVP-hard. 



4.1 Welfare Maximization with Known Valuations 

In the known valuations setting, we show the existence of a polynomial-time, e/(e— l)-approximation 
algorithm for welfare maximization in bipartite signaling. Formally, we prove the following result. 

Theorem 4.1. For bipartite signaling with known valuations, there is a randomized, polynomial- 
time, e/(e — 1)- approximation algorithm for computing the welfare-maximizing signaling scheme. 

As a warmup, in Section [4. we show that the special case of bipartite signaling without the 
cardinality constraint reduces almost directly to combinatorial auctions with XOS valuations. We 
then extend the result to the general case in Sections 14.1.21 and 14. 1 .31 through a non-trivial reduction 
to submodular function maximization subject to a matroid constraint. 



4.1.1 A Special Case: Without the Cardinality Constraint 

We show that welfare maximization in bipartite signaling with known valuations and without a 
cardinality constraint — i.e. with k = \S\ — reduces to welfare-maximization in combinatorial 
auctions^ with explicitly-represented XOS valuatio ns H w hich can be approximated to within a 



factor of -§y as shown by Donbzinski and Schapira DSOd ]. 

We are given a set of items 0, a distribution p € on items, a set of signals S, a bipartite 
graph E C Q x S, and known valuations v±, . . . ,v n 6 Mp. As in Section [2J we use Vi(j) = PjVi(j) 
as shorthand. A valid deterministic signaling scheme / : f2 — > S partitions the items O among 
signals S — we let B s = f~ 1 (s) denote the "bundle" of items mapped to signal s G S. Appealing 
to Equation (pQ), the welfare of / can then be written as: 

Vmax V Vi(j). 
*■ — * i=i » — * 

ses jeB a 

This can be extended to arbitrary partitions of the items — i.e. partitions not necessarily respecting 
the bipartite graph — by letting w s ij = Vi(j) for (j, s) £ E, and w s ij = for (j, s) E, and defining: 

welfare(B) = Vmax w s ij. 

ses j&B 3 

Since the weights w s ij do not reward assignments of items to signals not respecting the bipartite 
graph, finding the welfare-maximizing deterministic signaling scheme reduces to finding a partition 
B of items among signals maximizing welfare(B). 



7 In combinatorial auctions, there is a set M of items and a set N of players. Each player is equipped with a 
valuation mapping subsets of M to the real numbers. Welfare maximization in combinatorial auctions is the problem 
of assigning the items to the players in order to maximize the sum of the players' values for their assigned bundle of 
items. 

8 A set function / : 2 X — >• R is called XOS if it can be written as the maximum of additive set functions. Specifically, 
if f{A) = max*Lj X^-gA Wij for some integer k, and weights iwy £ R for i £ [k] and j £ X. We say an XOS function 
is represented explicitly if the weights Wij are given as input. 
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We observe that this is an instance of combinatorial auctions with XOS valuations. Namely, if we 
interpret the signals S as the "bidders" in combinatorial auctions, and B s as the "bundle" of items 
assigned to s, the valuation function of s is simply the XOS function f(A) = max" =1 YljeA Wsi 3- 
Welfare maximization in combinatorial auctions, when players have XOS valuations written ex- 
plicitly , admits an e/(e — 1) approximation algorithm that runs in polynomial time, as shown in 
When combined with Lemma 13.21 this proves Theorem 14.11 in the absence of a cardinality 
constraint. 



4.1.2 The General Case: Reduction to Optimization over Mappings 

We now consider the bipartite signaling problem with a cardinality constraint k on the number 
of signals used. As should be clear from Section 14.1. 1| the general case of bipartite signaling 
reduces to a generalization of combinatorial auctions with XOS valuations — namely, with the 
additional constraint that at most k players win any items in the combinatorial auction. We are 
not aware of previous work on this problem, and therefore design an e/(e — 1) algorithm for bipartite 
signaling directly. We break our proof in two parts: first, in this section we show that computing 
an approximately welfare-maximizing scheme reduces to "guessing" the mapping from signals to 
winning players, then in Section 14.1.31 we show how to express optimization over these mappings 
as submodular function maximization sub ject to a matroiatJ constraint, which admits an e/(e — 1) 
approximation algorithm by the result of Von08l | . 



We begin by observing that every signaling scheme induces a many-to-one mapping w : S —> 
[n] U{*}, which maps each signal to the winning player given that signal, where * denotes an unused 
signal. For determinstic signalling schemes that are valid for our instance of bipartite signalling, 
w(s) = * for all but at most k signals s. We call such mappings w feasible winner mappings. We 
reduce the problem of computing a near optimal signalling scheme to an optimization problem over 
feasible winner mappings w. 

Given a "guess" for the feasible mapping w associated with the welfare-maximizing signalling 
scheme, computing a deterministic optimal signalling scheme is trivial: each item j £ f2 is mapped 
to a winning player who likes it most subject to respecting the bipartite graph E. Formally, for 
every mapping w : S — > [n] U {*} where w(s) ^ * for at most k signals, we let f w : f2 — > S be a 
deterministic signalling scheme satisfying 

fw{j) G argmax v w{s) (j) 

for items j where such a signal s exists, and f w (J) is the "no information" signal sq £ S otherwise 
(recall that sq is a valid signal for all items, see Section [2]). The social welfare of signalling scheme 
f w is, by appealing to Equation ([1]), at least 

welfare(w) = ^ ^ v w{s )(j)- 

Reversing the order of summation, and observing that f w maps j to a signal maximizing v w r s \(j) 
subject to respecting the bipartite graph, gives the following equivalent expression for welfare(w): 



9 Recall a matroid (e.g. [Oxl92| ) is a ground set X and a non-empty collection X C 2 X of independent sets such 
that: (i) whenever S is independent and T C S, T is also independent; (ii) whenever S, T € I with \T\ < \S\, there 
is some x G S\T such that T U {a;} € 1. 
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we, 



lfare(w) = 



max 



(3) 



The social welfare of f w is at least welfare(w). Note, however, that f w may be infeasible, in that 
it may use up to k + 1 signals including so — however, in that case w(sq) = *, and therefore a 
feasible signalling scheme with welfare at least welfare(w) can be gotten by simply choosing an 
arbitrary signal s ^ sq with w(s) 7^ *, and reassigning all items f^ ( s ) to the "no information" 
signal so- Moreover, when w is the mapping associated with the welfare-maximizing valid signalling 
scheme, f w is a welfare maximizing valid signalling scheme with welfare exactly equal to welfare(w). 
Therefore, finding an approximately welfare-maximizing signalling scheme reduces to finding a 
mapping w approximately maximizing welfare(w). We summarize this in the following Lemma. 

Lemma 4.2. Fix a > 0. Computing an a- approximately welfare maximizing bipartite signalling 
scheme reduces, in polynomial time, to computing a feasible winner mapping w : S — > [n] U {*} 
which a -approximately maximizes welfare(w), as given in Equation ([3]). 

4.1.3 The General Case: Optimization over Feasible Winner Mappings 

We now show how to find a feasible winner mapping w : S — > [n] U {*} which approximately 
maximizes wel f are(w) , as given in Equation ([3]). We do so by posing this as a submodular func- 
tiorj^l maximization p roblem subject to a truncated partition matroia\^\ constraint, and invoking 
the result of Vondrak |Von08l ] which shows a polynomial-time e/(e — l)-approximation algorithm 
for submodular function maximization subject to an arbitrary matroid. 

Recall that we defined a winner mapping w as feasible if w(s) ^ * for at most k signals s G S. 
In order to pose our optimization problem as a constrained submodular maximization problem, we 
first relax the set of feasible mappings as follows. We consider many-to-many mappings W Q Sx[n] 
from signals to players, and define the welfare of such a mapping W as follows: 



In other words, each item j may be assigned to a player i so long as there is a signal s that is 
valid for j, and i as one of the "winning" players of s as given by W; the welfare-maximizing such 
assignment is used to calculate welfareiW). 

When W is a many-to-one mapping — i.e. assigns to each signal s at most one winning player 
w(s) — it is easy to verify that welfare(W) (Equation (pp) is equal to welfare(w) (Equation ([3])). 
Moreover, many-to-one maps W satisfying \W\ < k are in one-to-one correspondance with the set 
of feasible winner mappings w : S — > [n] U {*}, where feasibility is as defined in Section [4.1.21 It 
is simple to verify that the family of subsets W of S x [n] satisfying those two constraints is a 
truncated partition matroid on ground set S x [n]. 

10 A function / : 2 U — > R defined on all subsets of a finite non-empty set U is submodular if 



for every T C S C U and i <£ S. 

11 A truncated partition matroid (sec 0x192]) is a matroid ((7,7) with the following structure. There exists a 
partition Ui, . . . , U m of ground set U, integers ki, . . . , km, and an integer k, such that a subset S of U is independent, 
i.e. is in /, if and only if \S C\Uj \ < kj for all j £ 1, ... , m, and moreover \S\ < k. 





f(SU{i})-f(S)<f(TU{i})-f(T) 
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We now show that welfare(W) is submodular. We define for each j E £1 and (s, i) E [S] x [n] 
a weight = Vi{j) when (j,s) E -E 1 , and w s ij = otherwise. We then rewrite welfare(W) as 
follows. 

welfare(W) = > max w s ij. (5) 

Observe that welfare(W) is the sum of set functions, namely the functions welfarej(W) = 
max( s j) g ^y w s ij for ah j £ 0- It is known, and easy to verify, that any set function / : 2 X — > K that 
simply associates a fixed weight with each element x £ X, and evaluates to f(S) = max^s w x , is 
submodular. Therefore, by extension, welfarej(W) is submodular for each j. It is also well known 
that submodular functions are closed under summation. Therefore, we conclude that welfare(W) 
is submodular. 

Since welfare(W) is submodular, and moreover the set of W c orresponding to feasible winner 
mappings is a matroid, invoking the the result of Vondrak Von08| yields the followin Lemma. 



Lemma 4.3. There is a polynomial-time e/ (e— 1) approximation algorithm for computing a feasible 
winner mapping w maximizing welfare(w), as given in Equation ([3]). 

Combined with Lemma 14.21 this completes the proof of Theorem 14. 1[ 



4.2 Revenue Maximization with Known Valuations 

Next we show that, in the case of known valuations, there is a polynomial-time, constant factor 
approximation algorithm for revenue maximization in cardinality constrained signaling. Our algo- 
rithm (Algorithm [T]) simply chooses the best of two signaling schemes, computed via procedures 
[2] and O We use OPTR and OPTW to denote the maximum revenue and welfare, respectively, 
of a cardinality-constrained signaling scheme, and Vi(*) = Ej^ p Vi(j) to denote player i's value for 
a random item. Moreover, we let v* = maxiVi(*) denote the maximum value of a player for a 
random item, and let i* be the player attaining this maximum. We note that v* upper-bounds the 
contribution of any individual player to the social welfare of any signaling scheme. 

Input: Instance of cardinality constrained signaling, given by 0, k, valuations v%,. . . ,v n 
Output: Signaling scheme x* 

1: Run Procedure [2] to compute deterministic signaling scheme g. 

2: Run Procedure [3] to compute signaling scheme x. 

3: Let x* be the revenue-maximizing signaling scheme among g and x 

Algorithm 1: Algorithm for Cardinality-constrained Signaling 

We now provide some intuition for our algorithm. The signaling scheme computed by Procedure 
[2] guarantees near-optimal revenue when no individual player's contribution to the optimal social 
welfare is too large. An approximately welfare-maximizing signaling scheme / is computed as 
described in Section 14. 1} then signals are sorted in decreasing order of their contribution to the 
social welfare, and then pairs of signals are "merged" in that order. Formally, merging two signals 
s and i in a deterministic signaling scheme / : Q — > S gives a new signaling scheme g with 
g(j) = {s,t} whenever f(j) = s or f(j) = t, and g(j) = f(j) otherwise. Merging two signals s 
and t is tantamount to forcing the two winners of the auction in each of the signals to compete, 
extracting the value of at least one of them as revenue. Therefore, merging pairs of signals in order 
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Input: Instance of cardinality constrained signaling, given by 0, k, valuations v\, . . . ,v n 
Output: Deterministic signaling scheme g : £1 — > [k] 
1: Compute a deterministic signaling scheme which approximately maximizes welfare (Section 
SU). 

2: Repeatedly merge pairs of signals with the same winner, until each signal has a unique winner. 

Call the resulting signaling scheme /. 
3: Sort the signals in decreasing order of their contribution to the social welfare of /: S\, . . . , 
4: Let g be the signaling scheme which merges signals Si and Sj+i in /, for all odd i. 

Procedure 2: First Sub-procedure for Cardinality-constrained Signaling 
Input: Instance of cardinality constrained signaling, given by Q, k, and prior T> over valuations 

Vl,...,V n 

Output: Signaling scheme x 

1: Exclude i* , then compute a deterministic signaling scheme h approximately maximizing welfare 
for other players (Section 14. lj) . Let welfare{h) denote its welfare (excluding i*), and let v s = 
maxj^j* X)jeh _1 («)^C?) denote the contribution of signal s to the welfare. 

2: Let q = v* / wel f are(h) . 

3: Let y be the signaling scheme which ignores the realization of the item, and outputs signal s 

with probability a^f . (It is easy to verify the probabilities sum to 1). 
4: Let x be the signaling scheme which with probability 0.5 runs h, and with remaining probability 

0.5 runs y. 

Procedure 3: Second Sub-procedure for Cardinality-constrained Signaling 

of their contribution to the social welfare extracts half the welfare of all but the most valuable signal 
in /. When no individual player contributes much to the social welfare, this is a constant-factor of 
the welfare of /. 

The signaling scheme computed by Procedure El on the other hand, guarantees near-optimal 
revenue when a single player accounts for a large fraction of the optimal social welfare. In this case, 
i*'s value for a random item, namely v*, is on the order of the optimal social welfare. Procedure [3] 
first computes a deterministic signaling scheme h which e/(e — l)-approximately maximizes welfare 
for players other than i*. Then h is "mixed" with a signaling scheme y which releases no information 
- i.e. outputs a random signal independent of the realization of the item. Here, mixing two 
signaling scheme is defined as running each with equal probability. When the probability of each 
signal s in y is proportional to the contribution of s to the welfare of h, player i*'s value conditioned 
on s is on the order of the value of the welfare of h conditioned on s. Therefore, i* serves as a 
price-setting player for all signals, extracting a constant fraction of the social welfare of h in the 
process. Since, by Lemma 13.31 the welfare of h is a (1 — l/e)-approximation to the maximum 
revenue of any signaling scheme, this yields a constant approximation to the optimal revenue. 

We now present a formal proof of the approximation ratio of our algorithm. The result follows 
from two Lemmas. 

Lemma 4.4. Fix f3 > 0. If v* < fiOPTW, then signaling scheme g — as computed by procedure 
IE — has revenue at least ^—H^—^-OPTW. 

Proof. Note that welfare(f) > (1 — l/e)OPTW . It is an easy observation that Step 2, which 
merges signals with the same winning player, preserves the welfare of /. 
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Our assumption that any player's value for a random item is at most (30PTW implies that 
signal s\ accounts for no more than (50PTW of the welfare of / — formally maxj 5Zje/ _1 ( s ) — 
v* < (30PTW . Therefore, signals other than s% account for at least (1 — 1/e — f3)OPTW welfare 
in /. 

Now, recall that g simply merges pairs of signals in /. Given two signals s and t in /, merged 
into a new signal {s,t} in g, and an arbitrary player i, we observe that 

^0') = m ^0') + £ Mo)- 

jeg-H{s,t}) jef-^s) jef-Ht) 

Intuitively, the conditional value of player i for the new merged signal, weighted by the probability 
of the signal, is equal to the sum of i's weighted conditional values for both the component signals. 
This implies that, given a merged signal {s, i] in g, each of the (distinct) winners of s and t, which 
we denote by i s and it, have at least as much (weighted) value for {s,t} as they did for s and t 
individually. Since the player with the greatest weighted conditional value for a signal wins, and 
pays the second-greatest weighted value in expectation, we conclude that the contribution of {s,t} 
to the revenue in g is at least the minimum of the contributions of s and t to the welfare of /. 

Recalling that we sorted the signals in / in decreasing order of their contribution to the social 
welfare, and then merged them pairwise in that order, we conclude that the revenue of g is at least 
half the welfare of / after discarding s\. Our bound on the contribution of s% to the welfare of / 
then completes the proof. □ 

Lemma 4.5. If v* > {30PTW , then x — as computed by procedure [2 — has revenue at least 
f(l - l/e)OPTR. 

of Iemma \4-5\ First, observe that a, as stated in procedure^ is at least /3. Moreover, Lemma l3.3l 
combined with the result of Theorem l4.lt shows that welfare(h) > (1 — l/e)OPTR. It remains to 
show that x extracts at least a a/2 fraction of the welfare of h in revenue. 

Let i s denote the winning player of signal s in h (after excluding i*). Recall that v s , as defined 
in procedure O denotes the value of player i s conditioned on signal s, weighted by the probability 
of the signal. Now consider signaling scheme x, which mixes — in equal measure - signaling scheme 
h with the scheme which outputs s with probability a^t- The (weighted) value of i s for signal s in 
x is at least half what it was in h — namely v s /2. Moreover, the (weighted) value of i* for signal s 
is at least his value for a random item times the probability that signal s is output without regard 
to the realized item — doing the calculation, this is v* ■ \ ■ a^f = av s /2 . 

Now, in x both i* and i s have (weighted) value for signal s equal to at least av s /2. Therefore, 
the contribution of s to the revenue is at least this amount. Summing over all signals, the total 
revenue of x is at least ^welfare(h). This completes the proof. □ 

Setting f3 = 2e-i * n L emmas 14.41 and 14.51 proves the following theorem. 

Theorem 4.6. Algorithm^ computes a ^t^t^ ~ 8.17 approximation to the optimal revenue in 
the cardinality- constrained signaling problem. 

Note 4.7. We note that optimizing Procedure^ to mix h and y with probabilities 7 = a/{l + a) 
and (1 — 7), instead of 0.5 each, improves the approximation ratio in our theorem to 6.47. We omit 
the details. 
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4.3 Unknown Valuations 



We largely leave open the polynomial-time approximability of welfare and revenue maximization in 
the unknown valuations setting. Even in the case of welfare maximization in cardinality-constrained 
signaling, it appears challenging to design approximation algorithms with run-time scaling sub- 
exponentially in the support size of T>, the distribution over player valuation profiles. Nevertheless, 
we present here an extension of the result of Section 14.1.11 to distributions T> with constant size 
support. The runtime of the algorithm scales exponentially in the size t of the support. Moreover, 
we establish a connection of this problem to a generalization of the combinatorial auctions problem 
used in Section 14.1.11 

We assume the distribution D over valuation profiles is listed explicitly as a set of matrices 
{w 1 , . . . , u*} where v i G KM* , and associated probabilities qi, . . . ,qt- Using a similar derivation 
to that in Section 14.11 the welfare of a deterministic signaling scheme / can be written as 

t 

J^^^max %U)- 
sese=i jef-H») 

Recall that, as described in Section [4.1.11 the variant with t = 1 can be interpreted as an instance 
of combinatorial auctions with players corresponding to S, who are equipped with XOS valuations. 
Similarly, the variant with general t can be interpreted as an instance of combinatorial auctions 
where each player's valuation is a sum of XOS functions. We are not aware of any non-trivial 
polynomial-time algorithms for this problem that run in time polynomial in t in the computational 
complexity model. Howev er, since XOS valuations, and therefore their sums, are subadditive, the 



algorithm of Feige [FeiQq ] guarantees a 2-approximation if players can answer demand queries. 
Unfortunately we can show that, unlike for XOS functions, answering a demand query for a sum of 
XOS functions, even approximately to within a constant factor, is NP-hard — the proof is deferred 
to the full version of this paper. However, this does not rule out other approaches to our problem 
not involving demand queries. 

We now show that a 1 — 1/e approximation is possible in time exponential in t, and polynomial 
in all other parameters of an instance. We rewrite the welfare of a signaling scheme / as follows. 



t 



V max V Y]qevt(j). 

* '»1,«2, •••,l< * * *■ * 

ses ' ' ' jef-Hs)t=i 

This, again, is an instance of combinatorial auctions with XOS valuations, though each XOS func- 
tion is the maximum of n t additive functions. The e/(e — l)-approximation algorithm of [DS06I ] 
then runs in time polynomial in n t . 



4.4 Hardness of Approximation 

We now show that our approximation ratio for welfare-maximization in bipartite signaling is tight, 
even for the special case of cardinality-constrained signaling and known valuations. As a corol- 
lary, the same hardness of approximation result holds for revenue maximization. We use an 
approximation-preserving reduction from the APX-hard problem max-cover. An instance of max- 
cover is given by a ground set [m], a family A\,. . . ,A n of subsets of [m], and an integer k. The 
goal is to find k sets from A±, . . . , A n whose union is as large as possible. 



15 



Given an instance of max cover, we construct an instance of cardinality- constrained signaling 
with known valuations as follows. We let the set of items be [m], and associate with each set Ai 
a player i with valuation v\ : [m] — > {0, 1} such that Vi(j) = 1 if and only if j G Ai. Moreover, we 
let k be the constraint on the number of allowable signals, and let p be the uniform distribution 
over f2. 

Given a solution Ai x , . . . , A{ k for max-cover covering m' items, we show a signaling scheme with 
welfare at least m'/m. We assign items in An to signal 1, then assign items in Ai 2 \ A{ x to signal 
2, and so on until signal k. We observe that, for each signal I G [k], there is at least one player - 
in particular player %i — who values at least \An \ U^^An'l of the items assigned to signal t. This 
implies that the welfare of the signaling scheme is at least — | U^ =1 Ai e \ = m'/m. 

Conversely, given a signaling scheme with welfare m'/m, we show a solution to max-cover with 
coverage of at least m' . Each signaling scheme partitions the items into k subsets B\, . . . , B^, each 
of which — say Bp — is associated with a winning player ig. The welfare of the signaling scheme 
is the sum, over all winning players t£, of the number of items in Bi valued by scaled by the 
per- item probability of ^. Formally, the welfare is ^ Y2e=i |A<n-B^|. Letting m' = J2e=i l^ 1 " 1 -^!; 
it is clear from the fact that B\, . . . , B^ is a partition of the items that | U^ =1 AjJ > m', as needed 
to show a solution to max-cover with coverage at least m'. 

Th e above reduction, coupled with the hardness of approximation result for max-cover given in 
Fei98l ] . yields the following thereom. 

Theorem 4.8. There is no polynomial-time c- approximation algorithm for welfare-maximization in 
cardinality- constrained signaling with known valuations, for any constant c < — unless P = NP. 

The hardness result of Theorem 14,81 also holds for revenue maximization. This follows from a 
simple reduction from welfare maximization to revenue maximization: given an instance of cardi- 
nality constrained signaling, produce a new instance whose welfare and revenue are equal by simply 
duplicating each player. 

Corollary 4.9. There is no polynomial-time c- approximation algorithm for revenue-maximization 
in cardinality- constrained signaling with known valuations, for any constant c < — ^y, unless P = 
NP. 

5 Communication Bounded Signaling Schemes 

In this section, we consider signaling schemes in which items y G f2 correspond to points in d 
dimensional Euclidean space M d . In such settings, we consider valuation functions which are also 
parameterized by points Vi G M d . Natural valuation functions then include inner products (i.e. 
Vi(y) = (y,Vi)) and distances (i.e. Vi(y) = \\y — Vi\\). We think of d as being very large, and 
so we will be concerned with space bounded signaling schemes, defined to be schemes that can 
communicate only a bounded number of bits per signal. 

Definition 5.1. A finite set of signals S has b-bounded length i/log|5| < b. The set of b-bounded 
length signaling schemes is J 7 CI S n such that for each f G F: the set of all possible signals generated 
by f (i.e. U y ^f{y)) has b bounded length. We call such an f G F a b-bounded length signaling 
scheme. 

Remark 5.2. Note that any signal in a b-bounded length signaling scheme can be transmitted using 
at most b bits. 
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5.1 Inner Product Valuations 



Let !! = {!/£ : ||y||i = 1} be the set of d dimensional non-negative real vectors with l\ 
weight 1. These can be thought of as distributions over d "features" which describe the product 
y. Individuals i have valuation functions Vi : £1 — > M parameterized by (abusing notation) a vector 
V{ G M. d with 1 1 Vi | |oo < 1. Bidder i's valuation for good y is defined to be Vi(y) = (vi,y). Intuitively, 
each component j of Vi represents agent i's affinity for feature j, which can range in [—1, 1]. Vi(y) is 
agent i's average affinity for the distribution over features represented by good y. We wish to design 
good 6-bounded length signaling schemes for inner product valuations, for b as small as possible. 



5.1.1 Multiplicative Weights Signaling 



In this section, we use the versatile multiplicative weights framework of [AHK12I ] to give a com- 
munication bounded signaling scheme. The idea is the following: For simplicity, we first consider 
the known valuation setting in which the signaling scheme can be parameterized by the actual 
valuations vi, . . . ,v n of the bidders. When a good y S ft arrives, we use multiplicative weights to 
learn an e-approximate representation y with respect to the bidder valuation functions vx,...,v n 
- that is, a representation y such that for all i, \vi(y) — Vi(y)\ < e. We can do this by updating 
multiplicative weights at most 0(logd/e 2 ) times using the valuation functions themselves as loss 
functions, y would itself therefore make a terrific signal - it would approximately represent every 
bidder's valuation for the good y. However, y is also a vector in M. d , and so it is not clear why 
we should be able to communicate it in a space bounded way. The key insight is that it is not 
necessary to communicate y directly, but merely communicate which collection of valuation func- 
tions were used to update multiplicative weights when learning y - using this information, each 
bidder can reconstruct y for themselves. (Of course, this "reconstruction" can be automated, so 
the bidders can still see a natural signal). Since each valuation function can be indexed with only 
O(logra) bits, and there are only 0(logd/e 2 ) updates in total, this gives a 0(lognlogd/e 2 )-space 
bounded signaling scheme that approximates the optimal welfare within an additive loss of e. We 
then extend this to the case in which the valuation functions Vi are not known, but instead drawn 
i.i.d. from a known prior V . This extension involves parameterizing the same multiplicative weights 
signaling scheme with m i.i.d. samples from V . m here corresponds to the sample complexity of the 
corresponding learning problem on linear valuation^] and the space used by this signaling scheme 
depends on logm (since we must index updates from this set of m vectors). We now define our 
signaling scheme formally. 

We define a signaling scheme fMW,e,z 1 ,...,z m parameterized by a no regret algorithm (in this case 
the multiplicative weights algorithm MW), an accuracy parameter e, and m vectors z\, . . . , z m £1^ 
The parameters of the signaling scheme will be public knowledge, and it will be used to generate 
6-bounded length signals as follows: 

Theorem 5.3. For any e, any vectors Zi, . . . ,z m such that for all i, ||^i||oo ^ 1; an d any y G O, 

fMW,e, Zl ,...,z m runs for T< 16 '° gd rounds. 

Proof. f\\\\\,.~- (y) ru ns an instantiation of the Multiplicative Weights Framework for Arora, 



Hazan, and Kale [AHK12I ] for T rounds, with update parameter e/4, and loss vectors at each round 



12 The sample complexity of a learning problem is, informally, the number of samples that need to be drawn from a 
distribution V ', such that if we learn a hypothesis that is consistent on the sampled points, then with high probability, 
the hypothesis is consistent on new points drawn from the same distribution. 
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Input: An instance y G Vt. 


Output: A bounded length signal s. 


1 


Initialize y 1 G K d such that yj = l/d for all j G [d]. 


2 


Initialize T -<— 1. 


3 


while there exists an index i such that — (zi,y T }\ > e/2 do 


4 


Let Update T <- i, Sign T <- sign((zj,y T ) - (zi,y)), 


5 


For all j let <- yj ■ (l - Sign T • f • ay) . 


6 


Normalize such that i = 1- Let T T + 1 


7 


end while 


8 


Let s = ((Updatex, Sign^, . . . , (Update^, Sign T )) 


Algorithm 4: Algorithm for computing the signal /MW,e,zi,...,z m 



t defined to be V = Sign t • zupdate t ■ By the regret bound of Multiplicative Weights (see e.g. [AHK12I ] 
Corollary 2.2), we have for all x G K+ with ||x||i = 1: 

£(<«>^*>)<|f>V> + ^ 
t=l t=l 

where denotes a coordinate-wise absolute value. Note that this corresponds to the standard 
"no regret bound" that readers may be more familiar with: here the "experts" correspond to the d 
standard basis vectors, x corresponds to a distribution over experts, and the above bound simply 
states that multiplicative weights achieves diminishing regret with respect to the best expert (and 
therefore with respect to any distribution over experts). Taking x = y, we note that the loss 
vectors £ = Sign t • 2u p d a te t have been constructed such that at every round t, (£ i , j/*) - (£*, y) > e/2. 
Moreover, since for all i II 

^||oo — 1; by definition for each coordinate j, ^ 1. Therefore, for 
each t, < 1 since ||y||i = 1 • Therefore, the above bound becomes: 

Te Te 41nd 

T S T + — 

Solving for T, we find that it must be that T < 16 *° gtj as desired. □ 

We now make two observations. The first is that fww,e,zx,...,z m {v) produces bounded length 
signals: 

Corollary 5.4. For any e, any vectors z\, . . . ,z m such that for all i, ||zj||oo 

< 1, and any y G O, 

f MW,e,z\,...,z m is a b-bounded length signaling scheme for b = ( 161o s rf ( 1 °g m + 1 ) 



Proof. For t = 1, . . . ,T, Update t can be communicated with logm bits and Sign t can be commu- 
nicated by 1 bit. By Theorem [Ol for all y G SI, T < □ 

The next is that the signal s = ((Update^ Sign^, . . . , (Update-^, Sign T )) is sufficient for each 
agent i to reconstruct y T+1 : 

Observation 5.5. y T+1 = y T+1 {s) is a function only of the signal s = (( Update 1 , Sign^), . . . , ( Update T , Signup)). 
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Given this observation, it is helpful to think about the signal "really being" the vector y T+1 
that well approximates (y, Zj) for all i. The signal s is just a concise way of transmitting this vector. 

First, we show that when we have known valuations, the multiplicative weights signaling scheme 
is competitive with the optimal 6-bounded length signaling scheme. 

Theorem 5.6. Let OPT\j = X^gn P r j~pb' = y] " max iG[n] v i(y) denote the optimal social welfare in 
the unconstrained setting. In the known valuation setting, the welfare obtained by the multiplicative 
weights signaling scheme given vectors (z±, ... , z n ) = (vi, . . . , v n ) is: 

welfare(f M w,e,v u ...,v n ,v) > OPT v - e 

In particular, it is within e of the optimal welfare obtained by any bounded length signaling scheme. 

Proof. Fix any yeH, consider s = s{y) = fMW,e,vi,...,v n {y), and let y T+l = y T+1 (s). For any bidder 
i, let S = {y : \ {y,Vi) — (y ' 1 (s),Vi)\ < e/2} be the set of goods whose value to bidder i differs by 
less than e from the value of good y +1 . Note that by the construction of y +1 , it must be the case 
that Pr jr^ p [j S\s] = (because otherwise the multiplicative weights signaling scheme would not 
have halted). Therefore, we have Pr j^ p [j 6 S\s] = 1 and we can calculate: 



Vi\s(y) = Ej~ P [vi(j)\f(j) = s] =y / v i (j) ■ Pr[j\f(j) 



jen 



> Vi{j) ■ Pr[j\f(j) = s}> mmviU) ■ Pr[j G S\f(j) = s]> (v t (y) - e) ■ 1 

Finally, we can lower bound the expected welfare of the multiplicative weights signaling scheme, 
and compare it to the unconstrained optimal welfare. For all v: 

we\iaxe(fMW,e,vi,...,v n ,v) = Y] Pr[j = y] • maxvi\s(y) 
> V Pr[j = y] ■ max( Vi (y) - e) = OPTf/ - e 

^j~p ie[n] 

□ 

We now adapt our signaling scheme slightly, and show that it works not just in the known 
valuation setting, but also in the Bayesian setting when there is a prior V from which the valuations 
Vi of the agents are drawn i.i.d. Consider the slightly modified family of signaling schemes /', still 
defined in terms of an accuracy parameter e and m vectors z\, . . . , z m . The difference between /' 
and / is only that /' updates the multiplicative weights hypothesis at most 1 time for every vector 
Zi. This difference is not required for the accuracy theorem that we prove (i.e. we could just as 
well have used the signaling scheme defined by /), but simplifies the analysis. 

Because we continue to have that y T is updated only on vectors Z\ such that | (zj, y) — (zi,y T }\ > 
e/2, our bound on the number of updates is identical as it was for signaling scheme /, and so we 
have an identical corollary: 

Corollary 5.7. For any e, any vectors z\, . . . ,z m such that for all i, \\ 

Zi\\oo — 1? and any y G 
f' MWe Z1 Zm is a b-bounded length signaling scheme for b = ^ 161 °g rf 0°s m + 1 ) ^ _ 
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Input: An instance y G Vt. 




Output: A bounded length signal s. 




1 


Initialize y 1 G K d such that ??} = l/d for all 7 G Id]. 

tj [7 1 / J L J 




2 


Initialize T -<— 1. 




3 


for i = 1 to m do 




4 


if - (^,y T )| > e/2 then 




5 


Let Update T <- 1, Sign T <- sign((z i ,y- 1 ) - {zi,y}) 




6 


For all j let <- yj • (l - Sign T • § • z i:j ) . 




7 


Normalize y T+l such that 1 = 1. Let T 


T+l 


8 


end if 




9 


end for 




10 


Let s = ((Update!, Sign^, . . . , (Update^, Sign T )) 






Algorithm 5: Algorithm for computing 


the signal fUw,e, Zl ,...,z m 



We now argue that if / is parameterized with m vectors Zi drawn i.i.d. from V (for sufficiently 
large m), then in fact with high probability, e z Zm is a competitive signaling scheme for the 
actual agent valuations v\, . . . , v n , whenever v 1, . . . , v n are also drawn i.i.d. from V . 



Theorem 5.8. Let 

2n{m* + i) (log (3§§M) + log f ) fnlogd 
m = 6 = °{-J^- 

Fix any y G ft, and let Z\, . . . , z m and v\, . . . , v n be i.i.d. draws from V . Let s = f' MWe z Zm (y)' 
and define S(v,s) = {y : \(y,v) — (y T+l (s), v}\ < e/2}. Then we have: 

Pr [ y ^S(v,s)]<- 

z\,...,z m ,v^D n 

Proof. We will show that for any y G $7, with probability 1 — 5/2n over the choice of Z\ ? . . . , z m , s is 
such that: Pr v ^-p[y G" S(v, s)] < 6/2n, which is enough to prove our claim. Let U = 16 '° g d be the 
maximum number of update rounds that /^We z z can ever con duct, as bounded by Theorem 
15.31 Since /^w e z\ z m considers running an update on each z,- L in sequence but never conducts more 
than U updates, there must be some consecutive sequence Zi, . . . , Zj of length at least ( j — i + 1) > jj 
on which no updates are performed. We will show that if Pr„^x>[y S{v,s)] > 5/2n, then the 
probability of this event occurring is at most 5/2n. Note that if Pr^x>[y 5(u,s)] > 5/2n, since 
each Zi is independently sampled from V, the probability of an update occurring at round i is at 
least 5/2n. Therefore, the probability of there existing such a long sequence between updates is at 
most: 

(U + 1)(1 - — ) m/U <(U+ i) e -^/2nU 
2n 

Setting m as in the theorem statement makes this probability at most 8/2n as desired. □ 

A simple corollary of Theorem 15.81 is an analogous welfare guarantee for the multiplicative 
weights signaling scheme in the Bayesian setting: 
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Theorem 5.9. Let OPTjj = Ylyen P r j~pb' = v\ ' max ie[n] v i(y) denote the optimal social welfare 
in the unconstrained setting with known valuations. In the Bayesian setting in which each Vi ~ V 
is sampled i.i.d. from a known prior V , the welfare obtained by the multiplicative weights signaling 
scheme given vectors (z%, . . . , z m ) sampled independently from the prior distribution V is: 

welfare(f' MW ^ Vu Vm ,v) > OPT v -e-5 

where m = O ^ n ^°f ■ In particular, it is a 16 log d(log m + l)/e 2 bounded length signaling scheme 
that obtains welfare within e + 5 of the optimal welfare obtained by any bounded length signaling 
scheme. 

Proof. Independently for every y 6 Q, consider s = s(y) = fMW,e,v!,...,v n (y), and let y T+1 = y T+1 (s). 
For any bidder i, let 5j = {y : \(y,Vi) — (y T+1 (s),Vi}\ < e/2} be the set of goods whose value to bidder 
i differs by less than e from the value of good y T+l . By Theorem 15.81 Prj^ p [j £ Si\s\ > 1 — 5/n 
and so by a union bound Prj^ p [\/i, j £ Si\s] > 1 — 5 and we can calculate for all i: 

Vi\s(y) = Ej~ P [vi(j)\f(j) = s] 

= y £v l (j)-Pr[j\fti) = s] 

jen 

> J>(j)-Pr[j|/(j) = s] 

> minvi(j) • Pr[j € S\f(j) = s] 
jes p 

> ( Vl (y)- e )-(l-5) 

> Vi(y)-e-5 

where the last inequality follows from the fact that Vi{y) < 1. Finally, we can lower bound the ex- 
pected revenue of the multiplicative weights signaling scheme, and compare it to the unconstrained 
optimal welfare. For all v: 



welfare(/^ w z z ,v) = V Pr[j = y] ■ max Vi \s{y) 

> y~] Pr b' = y] ■ max(vi(y) - e - 5) 

^3~p ie[n] 

= OPTu-e-5 

□ 



5.2 Subspace Valuations 

In this section, we use a version of the Johnson Lindenstrauss lemma, for matrices implicitly 
defined by limited independence families of hash functions, to give bounded space signaling schemes 
for "subspace valuations". Subspace valuations are defined over a point set f2 of unit vectors in 
Euclidean space, and can be seen as a generalization of the "inner product valuations" considered 
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in the previous section 13 !. An agent may specify up to k points in ft, which indicates that he is 
equally happy with any linear combination of these k points (i.e. his k points define a subspace). 
His value for a good is defined to be its distance to this subspace. The Johnson Lindenstrauss 
lemma lets us take a "projection" of the point into a lower dimensional space, in such a way that 
with high probability, each agent is able to estimate its value with high probability. We use the fact 
that limited independence JL matrices can be concisely represented - this allows us to construct a 
new projection matrix for every good, and include its description as part of our signal. This allows 
us to give a strong Bayesian guarantee - our algorithm achieves close to optimal welfare against any 
(arbitrarily correlated) prior value distribution, even without knowledge of the distribution. Indeed, 
our algorithm works even against adversarially selected goods y € O, that need not be drawn from 
any distribution! We state our main theorem here but leave the details to the appendix. 

Let Q = {y £ M. d : \\y\\2 = 1} be the set of d dimensional unit vectors in Euclidean space. 
Individuals i have valuation functions parameterized by t{ orthogonal unit vectors z\,...,Zg. for 
some ti < k. These vectors define a subspace Si = span(z|, . . . , z} ), and the value that agent i has 
for a good y is the distance between y and agent i's subspace Sf. 

Vi{y) = l-d(y,Si) = l-min||x-y|| 2 

For each agent i, we can think of the vectors specifying up to k "ideal" goods, and 

that agent i is equally happy with any linear combination of his ideals. His valuation for a good 
y drops off with the distance from y to his set of ideal goods. Note that it is not necessary that 
agent i actually specify orthogonal goods - if his ideal goods Z-^ 5 • • • 5 tire not orthogonal, we can 
simply orthonormalize them (using, say, the Gram Schmidt algorithm), which does not alter the 
subspace that they define. 

We recall that for any y, argmin^g^ | |a: — 2/1 1 2 = Y2j=i{lli z j) ' z ji an d so we can write: d(y, Si) = 

vA -£?=!<*, 

To achieve a low space signaling scheme for subspace valuations, we make use of the Johnson- 
Lindenstrauss lemma. 

We will us e (a co rollary of) a limite d- independence version of the Johnson-Lindenstrauss lemma 



We will us e ( a co rollary olj a limited-indep endence version 01 tne J onnson- .Lindenstrauss lemma 
presented in |KNld |. first proven by (AchOll . ICWO^ . This version of the lemma holds even for 



concisely represented projection matrices, which allows us to communicate the projection matrix 
itself as part of our signal. The advantage of doing this is that our algorithm will get strong utility 
guarantees even in the prior free setting, when valuation functions can be drawn from a worst-case 
(arbitrarily correlated) prior on distributions, and goods can be selected by an adversary, rather 
than being drawn from any distribution. 

Corol lary 5.10 (The Johnson-Lindenstrauss Lemma with Limited Independence AchOl . lcW09l . 



KNld |). For d > an integer and any < e, 5 < 1/2, let A be aT x d random matrix with -izl/y/T 



entries that are r-wise independent for T > 4 • 64 2 e 2 log(l/<5) and r > 21og(l/<5). Then for any 
x,ye R d : 



Pr[\((Ax), (Ay)} - (x,y)\ > |(||x||l + ||y||^)] < 25 



13 The class of valuations may be seen as a generalization of inner product valuations, but the signaling scheme 
here works in a different range of parameters as the multiplicative weights signaling scheme. Specifically, for the 
multiplicative weights signaling scheme, we assumed that SI consisted of the set of unit vectors in l\ space, and that 
valuation functions were defined by unit vectors in space. In this section, both points y £ Q,, and the vectors 
which parameterize agent valuation functions are unit vectors in £2 space. 
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Input: An instance y £ 0. 
Output: A bounded length signal s. 

1: Generate aTxd random ±l/\/T- valued matrix A with r-wise independent entries for r 
21og(3nfc/e) and T = 131072fc2 J° g(3 "^ . 

2: Let y = Ay and let y 7 = y discretized to log(3d/e) bits of precision. 

3: Let s = {A,$). 



Algorithm 6: Algorithm for computing the signal /jL,fe,, 



Remark 5.11. The matrix A in our algorithm will be implicitly represented by a hash function 
mapping coordinates of the matrix A to their values. There are various ways to select a hash function 
from a family of r-wise independent hash functions mapping [T x d] — > {0, 1}. The simplest, and 
one that suffices for our purposes, is to select the smallest integer s such that 2 s > T x d, and 
then to let g be a random degree r polynomial in the finite field GF[2 S ]. Selecting and representing 
such a function takes time and space 0(r • s) = 0(r (log d + logT)). g is then an unbiased r-wise 
independent hash function mapping G¥[2 S ] — > GF[2 S ]. Taking only the last output bit gives an 
unbiased r-wise independent hash function mapping [s x d] to {0,1}, as desired. 

We first observe that /jL,fe,e generates bounded length signals. 
Observation 5.12. fjLke is an 

Q( k* iog(n/6) iog(<Ve) ( log d + log ( fe i og (n/e)))) -bounded length signal- 
ing scheme. 

Proof. This follows directly from our choice of r and T, the fact that A can be represented using 
0(r (log d + logT)) bits, and the fact that we discretize each coordinate of y 1 to log(3d/e) bits of 
precision. □ 

We now show that /jL,fe, e is welfare competitive with the optimal unconstrained signaling 
scheme. 

Theorem 5.13. Let OPTjj = J2 y en ^* r j~p[j = v\ ' max «e[n] v iiu) denote the optimal social welfare 
in the unconstrained setting. For every distribution V over subspace valuation functions and every 
distribution p over goods i/gfi, 

welfare(f JLAe ,v) > OPT v - e 

In fact, for every v, this guarantee holds pointwise for goods even if adversarialy chosen. For 

all y e Q, for s = fjL,k,e{v) ■' 

max y^x{j,s)pjVi(j) > max^(y) - e 
ie[n] ie[n] 

Proof. It suffices to prove the second, stronger claim. Fix a good y G SI and let fjL,k,e(y) = s = 

For each bidder i, define #( A, y, 5) = {x e Q : \ - J2%i( x i z j) 2 ~\/ 1 ~ £j=i<& Az j) 2 \ ^ 
5} By our choice of T, we have: Pr[y Si(A, y, e/3)] < e/3n, where the probability is taken over 
the choice of projection matrix A Moreover, by our choice of discretization, we have Si(A, y, e/3) C 
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Si(A, y 1 , 2e/3). Therefore by a union bound: Pr[3i : y £ S^A,^ 1 , 2e/3)] < e/3. Therefore, for all i: 

> ^ x{j,s)pjVi{j) 

~ ieS-uf2e/3) Vi( - j) S X C7>) Pj 

^(^,2^/3) W e/3) 

> - 2e/3) Pr[y G S f (A, y', 2e/3)] 

□ 



6 Conclusions and Future Work 

Our results initiate the study of signaling in constrained settings. Whereas we obtain preliminary 
positive and negative results for some natural problems in this setting, we leave open a rich selection 
of algorithmic problems. We conclude with a statement of several of these open questions. 

We leave several open questions in the bipartite signaling setting. Is there a constant-factor 
approximation algorithm for revenue maximization in this setting with known valuations? What 
about welfare or revenue in the unknown valuation setting, for which we obtain no nontrivial 
guarantees? 

More generally, we leave open structural questions in constrained signalling problems more 
generally. We showed that there always exists a deterministic welfare-maximizing signaling scheme. 
What about the relative power of determ inistic and randomized signaling schemes for revenue 
maximization? It was shown in (EFG+121 ] that in unconstrained settings, there always exists a 



revenue-maximizing scheme with at least half the optimal welfare. Does such a tradeoff hold in 
constrained signaling problems? 

Finally, there are many other natural signaling problems one may consider. For example, what 
if products are given as points in a high dimensional hypercube or a high dimensional euclidean 
space, and an auctioneer must signal a subset of the coordinates? Problems of this form appear 
related to deep questions in learning theory, such as learning /c-juntas and others. 



References 



[ABKll] F. Armisen, C. Brownstein, and J. Krisel. Farm. Portlandia, 2011. 

[AchOl] D. Achlioptas. Database-friendly random projections. In Proceedings of the twentieth 
ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems, page 
281. ACM, 2001. 

[AHK12] Sanjeev Arora, Elad Hazan, and Satyen Kale. The multiplicative weights update method: 
A meta-algorithm and applications. Theory of Computing, 8:121-164, 2012. 

[Ake70] G.A. Akerlof. The market for "lemons" : Quality uncertainty and the market mechanism. 
The Quarterly Journal of Economics, 84:488-500, 1970. 



24 



K.L. Clarkson and D.P. Woodruff. Numerical linear algebra in the streaming model. In 
Proceedings of the 41st annual ACM symposium on Theory of computing, pages 205-214. 
ACM, 2009. 

Shahar Dobzinski, Noam Nisan, and Michael Schapira. Approximation algorithms for 
combinatorial auctions with complement-free bidders. In Proceedings of the 36th ACM 
Symposium on Theory of Computing (STOC), pages 610-618, 2005. 

Shahar Dobzinski and Michael Schapira. An improved approximation algorithm for 
combinatorial auctions with submodular bidders. In Proceedings of the 17th ACM Sym- 
posium on Discrete Algorithms (SODA), pages 1064-1073, 2006. 

Y. Emek, M. Feldman, I. Gamzu, R. Paes-Leme, and M. Tennenholtz. Signaling schemes 
for revenue maximization. In ACM Conference on Electronic Commerce (EC), 2012. 

Uriel Feige. A threshold of In n for approximating set cover. Journal of the ACM, 
45(4): 634-652, 1998. 

Uriel Feige. On maximizing welfare where the utility functions are subadditive. In 
Proceedings of the 31th ACM Symposium on Theory of Computing (STOC), pages 122- 
142, 2006. 

A. Ghosh, H. Nazerzadeh, and M. Sundararajan. Computing optimal bundles for spon- 
sored search. In Workshop on Internet and Network Economics (WINE), 2007. 

Anupam Gupta, Aaron Roth, and Jonathan Ullman. Iterative constructions and private 
data release. In Ronald Cramer, editor, TCC, volume 7194 of Lecture Notes in Computer 
Science, pages 339-356. Springer, 2012. 

Moritz Hardt and Guy N. Rothblum. A multiplicative weights mechanism for privacy- 
preserving data analysis. In FOCS, pages 61-70. IEEE Computer Society, 2010. 

D.M. Kane and J. Nelson. A derandomized sparse johnson-lindenstrauss transform. 
Arxiv preprint arXiv: 1006. 3585, 2010. 

J. Levin and P. Milgrom. Online advertising: Heterogeneity and conflation in market 
design. American Economic Review, 100:603-607, 2010. 

P. Milgrom. Simplified mechanisms with an application to sponsored-search auctions. 
Games and Economic Behavior, 70:62-70, 2010. 

P.B. Miltcrsen and O. Sheffet. Send mixed signals - earn more, work less. In Workshop 
on Internet and Network Economics (WINE), 2012. 

P. Milgrom and R.J. Weber. A theory of auctions and competitive bidding. Economet- 
rica, 50:1089-1122, 1982. 

J. G. Oxley Matroid Theory. Oxford University Press, 1992. 

Aaron Roth and Tim Roughgarden. Interactive privacy via the median mechanism. In 
Leonard J. Schulman, editor, STOC, pages 765-774. ACM, 2010. 



25 



[Von08] Jan Vondrak. Optimal approximation for the submodular welfare problem in the value 
oracle model. In Proceedings of the 39th ACM Symposium on Theory of Computing 
(STOC), pages 67-74, 2008. 



26 



